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DETAILED ACTION 

Response to Amendment 

1 . As per the Applicant's instructions as filed in on 6/7/07, claims 2-20, 22-32, and 34 have 
been canceled, and claims 35-52 have been added. 

2. Applicant's arguments with respect to claims 1, 21, 33, 35-52 as filed on 6/7/07 have 
been considered but are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 102 

3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

4. Claims 1,21, 33, 35-52 are rejected under 35 U.S.C. 102(b) as being anticipated by 
Moezzi et al., (hereinafter referred to as "Moezzi"). 

Moezzi discloses network-based (Moezzi: column 38, lines 40-50) surveillance system 
(Moezzi: figure 17) for real time monitoring (Moezzi: column 22, lines 55-65) of an environment 
(Moezzi: figure 1), comprising: a first sensor service unit operatively coupled to a first 
immersive panoramic sensor for capturing in real time (Moezzi: column 25, lines 10-20) two or 
more overlapping digital images (Moezzi: column 24, lines 40-55) to generate first video data 
representing a first immersive panoramic field of view of the environment (Moezzi: column 23, 
lines 50-65; column 16, lines 25-35) a sensor subsystem for providing real time spherical image 
data and surveillance data (Moezzi: column 24, lines 10-25); a network operatively coupled to 
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the sensor system for delivering the spherical image data and surveillance data to a management 
console (Moezzi: column 38, lines 30-40); and a management console operatively coupled to the 
network for receiving the spherical image data and the surveillance data and generating a 
spherical view display using the spherical image data (Moezzi: column 34, lines 30-55) and 
situational awareness management display using the surveillance data (Moezzi: column 42, lines 
30-42), the network also operatively coupled to the first sensor service unit to allow transmission 
of the first video data from the first sensor service unit to the management console (Moezzi: 
column 23, lines 5-20), the management console including a sensor display subsystem for 
displaying an immersive panoramic video based at least in part on the first video data transmitted 
over the network from the first sensor service unit (Moezzi: column 33, lines 5-20); and a data 
repository operatively coupled to the network for storing and retrieving the first video data 
marked with time-indices (Moezzi: column 38, lines 30-40), the time indices representing times 
at which the overlapping digital images were captured by the first immersive panoramic sensor 
(Moezzi: column 29, lines 20-33), as in claim 1. 

Moezzi discloses a network-based (Moezzi: column 38, lines 40-50) method (Moezzi: 
column 9, lines 45-65) of real time monitoring (Moezzi: column 22, lines 55-65) an environment 
(Moezzi: figure 1), comprising: generating (Moezzi: column 23, lines 50-65; column 16, lines 
25-35), at a first sensor service unit (Moezzi: column 25, lines 10-20), first video data 
representing a first immersive panoramic field of view of the environment from two or more 
overlapping digital images (Moezzi: column 24, lines 40-55) captured in real time by a first 
immersive panoramic sensor capturing real-time spherical image data at a sensor subsystem 
(Moezzi: column 38, lines 30-40); monitoring the spherical image data for motion (Moezzi: 
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column 23, lines 29-37); responsive to detection of motion, generating motion detection event 
data (Moezzi: column 26, lines 15-35); delivering the spherical image data and motion detection 
event data to a management console via a network (Moezzi: column 33, lines 5-20); and at a the 
management console, displaying a first immersive panoramic video based at least in part on the 
first video data transmitted over the network from the first sensor service unit generating a 
spherical view display using the spherical image data (Moezzi: column 42, lines 30-42); and 
storing or retrieving, at a data repository, the first video transmitted over the network, the first 
video data marked with time indices (Moezzi: column 38, lines 30-40) representing times at 
which the overlapping digital images were captured by the first immersive panoramic sensor 
(Moezzi: column 29, lines 20-33), as in claim 21. 

Moezzi discloses a computer program product comprising computer-readable storage 
medium structured to store instructions (Moezzi: column 11, lines 55-67; column 12, lines 1-26: 
"software program") executable by a processor in a surveillance system (Moezzi: figure 1 7), the 
instructions, when executed, cause the processor to perform the operations of: at a first sensor 
service unit (Moezzi: column 25, lines 10-20), generate first video data (Moezzi: column 23, 
lines 50-65; column 16, lines 25-35) representing a first immersive panoramic field of view of 
the environment from two or more overlapping digital images (Moezzi: column 24, lines 40-55) 
captured in real time by a first immersive panoramic sensor receiving spherical image data and 
surveillance data from at least one sensor (Moezzi: column 38, lines 30-40); integrating the 
spherical image data and surveillance data (Moezzi: column 28, lines 35-45); and at a 
management console, display an immersive panoramic video based at least in part on the first 
video data transmitted over the network from the first sensor service unit (Moezzi: column 42, 
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lines 30-42) displaying the integrated spherical image data and surveillance data on a user 
interface and at a data repository (Moezzi: column 33, lines 5-20), store or retrieve the first video 
data transmitted over the network, the first video data marked with time indices representing 
times (Moezzi: column 38, lines 30-40) at which the overlapping digital images were captured 
by the first immersive panoramic sensor (Moezzi: column 29, lines 20-33), as claim 33. 

Regarding claims 35-37, Moezzi discloses wherein the first sensor service unit further 
comprises a motion detector for generating a sensor specific motion detection event data 
(Moezzi: column 23, lines 27-42) indicating detection of motion in the two or more overlapping 
images (Moezzi: column 23, lines 27, lines 35-50), the management console operatively coupled 
to the motion detector for generating a motion detection alarm event based on the sensor specific 
motion detection event data (Moezzi: column 42, lines 20-62), as in the claims. 

Regarding claims 38-39, Moezzi discloses a second sensor service unit operatively 
coupled to a second immersive panoramic sensor for capturing in real time two or more 
overlapping digital images to generate second video data representing a second immersive 
panoramic field of view of the environment, the second sensor service unit operatively coupled to 
the network to transmit the second video data to the management console (Moezzi: column 29, 
lines 15-30), as in the claims. 

Regarding claims 40-41, Moezzi discloses a second sensor service unit operatively 
coupled to a non-image surveillance sensor system, the non-image surveillance sensor system 
generating non-image event data based on surveillance of the environment but not based on 
overlapping digital images, the management console operatively coupled to the second sensor 
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service unit to receive the non-image event data via the network (Moezzi: column 47, lines 45-67; 
column 48, lines 1-45), as in the claims. 

Regarding claims 42-44, Moezzi discloses wherein the data repository comprises an 
image store for storing and retrieving the overlapping digital images received from the first sensor 
service unit via the network (Moezzi: figure 17), and a non-image store for storing and retrieving 
the non-image event data received from the second sensor service unit via the network (Moezzi: 
column 42, lines 23-62), as in the claims. 

Regarding claim 45, Moezzi discloses wherein the first sensor service unit transmits a 
heartbeat message to the management console, the heartbeat message indicating that the first 
sensor service unit is enabled and actively communicating with the management console via the 
network (Moezzi: column 29, lines 50-67; column 30, lines 1-23), as in the claim. 

Regarding claims 46-48, further comprising: at the first sensor service unit, generating a 
sensor specific motion detection event data indicating detection of motion in the two or more 
overlapping images (Moezzi: column 27, lines 35-50); and at the first sensor service unit, 
generating a motion detection alarm event (Moezzi: column 42, lines 20-62), based on the sensor 
specific motion detection event data (Moezzi: column 23, lines 25-35), as in the claims. 

Regarding claims 49-50, Moezzi discloses further comprising: at a second service unit, 
generating second video data representing a second immersive panoramic field of view of the 
environment from two or more overlapping digital images captured in real time by a second 
immersive panoramic sensor; at the management console, displaying a second immersive 
panoramic video based at least in part on the second video data transmitted over the network from 
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the second sensor service unit; and at the data repository, storing or retrieving the second video 
data (Moezzi: column 29, lines 19-41), as in the claims. 

Regarding claim 51, Moezzi discloses a at a second service unit, generating non-image 
event data based on surveillance of the environment but not based on overlapping digital images 
(Moezzi: column 47, lines 45-67; column 48, lines 1-45); at the management console, receiving 
the non-image event data via the network; and at the data repository, storing or retrieving the non- 
image event data (Moezzi: column 42, lines 23-62), as in the claim. 

Regarding claim 52, Moezzi discloses wherein the first sensor service unit transmits a 
heartbeat message to the management console, the heartbeat message indicating that the first 
sensor service unit is enabled and actively communicating with the management console via the 
network (Moezzi: column 29, lines 50-67; column 30, lines 1-23), as in the claim. 

Conclusion 

5. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 



Application/Control Number: 10/647,098 Page 8 

Art Unit: 2621 

however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Andy S. Rao whose telephone number is (571)-272-7337. The 
examiner can normally be reached on Monday-Friday 8 hours. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mehrdad Dastouri can be reached on (571)-272-7418. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

Andy S. Rao 



asr 

August 15, 2007 




